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RELATED APPLICATION DATA 



The present application is related to U.S. Patent Application Serial No. 
09/490,761 (Attorney Docket No. CISCP131), filed on January 24, 2000, and U.S. 
Patent Application Serial No. 09/606,503 (Attorney Docket No. CISCP145), filed June 
28, 2000, which claims priority under 35 USC 119(e) from U.S. Provisional Patent 
Application Serial No. 60/159,085 (Attorney Docket No. CISCP131P), filed on October 
13, 1999. The present application is also related to U.S. Patent Application Serial Nos. 

(Attorney Docket No. CISCP221), filed concurrently herewith, naming 

John Chapman as inventor. Each of these applications is incorporated herein by 
reference in its entirety for all purposes. 

BACKGROUND OF THE INVENTION 
The present invention relates to digital computer network technology. More 
specifically, it relates to a technique for synchronizing network devices in an access 
data network. 

Broadband access technologies such as cable, fiber optic, and wireless have 
made rapid progress in recent years. Recently there has been a convergence of voice and 
data networks which is due in part to US deregulation of the telecommunications 
industry. In order to stay competitive, companies offering broadband access 
technologies need to support voice, video, and other high-bandwidth applications over 
their local access networks. For networks that use a shared access medium to 
communicate between subscribers and the service provider (e.g., cable networks, 
wireless networks, etc.), providing reliable high-quality voice/video communication 
over such networks is not an easy task. 

One type of broadband access technology relates to cable modem networks. A 
cable modem network or "cable plant" employs cable modems, which are an 
improvement of conventional PC data modems and provide high speed connectivity. 
Cable modems are therefore instrumental in transforming the cable system into a full 
service provider of video, voice and data telecommunications services. 
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FIGURE 1 shows a block diagram of a conventional two-way hybrid fiber- 
coaxial (HFC) cable network 100. As shown in FIGURE 1, the cable network 100 
includes a Head End complex 102 typically configured to service about 40,000 homes. 
The Head End complex 102 may include a plurality of components and/or systems (not 
shown) such as, for example, a Head End, a super Head End, a hub, a primary hub, a 
second hub, etc. Additionally, as shown in FIGURE 1, the Head End complex 102 
typically includes a Cable Modem Termination System (CMTS). Primary functions of 
the CMTS include (1) receiving data inputs from external sources 100 and converting 
the data for transmission over the cable plant; (2) providing appropriate Media Access 
Control (MAC) level packet headers for data received by the cable system, and (3) 
modulating and demodulating the data to and from the cable network. Typically, the 
Head End complex 102 is configured to provide a communication interface between 
nodes (e.g. cable modems) in the cable network and external networks such as, for 
example, the Internet. The cable modems typically reside at the subscriber premises 
1 10A-D. 

The Head End Complex 102 is typically connected to one or more fiber nodes 
106 in the cable network. Each fiber node is, in turn, configured to service one or more 
subscriber groups 110. Each subscriber group typically comprises about 500 to 2000 
households. A primary function of the fiber nodes 106 is to provide an optical- 
electronic signal interface between the Head End Complex 102 and the plurality of 
cable modems residing at the plurality of subscriber groups 1 10. 

In order for data to be able to be transmitted effectively over a wide area 
network such as HFC or other broadband computer networks, a common standard for 
data transmission is typically adopted by network providers. A commonly used and well 
known standard for transmission of data or other information over HFC networks is the 
Data Over Cable System Interface Specification (DOCSIS). The DOCSIS standard has 
been publicly presented by Cable Television Laboratories, Inc. (Louisville, Colorado), 
in a document entitled, DOCSIS 1.1 RF Interface Specification (document control 
number SP-RFIvl. 1-106-001215, December 15, 2000). That document is incorporated 
herein by reference for all purposes. 

Communication between the Head End Complex 102 and fiber node 106a is 
typically implemented using modulated optical signals which travel over fiber optic 
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cables. More specifically, during the transmission of modulated optical signals, 
multiple optical frequencies are modulated with data and transmitted over optical fibers 
such as, for example, optical fiber links 105a and 105b of FIGURE 1, which are 
typically referred to as "RF fibers". As shown in FIGURE 1, the modulated optical 
5 signals transmitted from the Head End Complex 102 eventually terminate at the fiber 
node 106a. The fiber nodes maintain the signal modulation while converting from the 
fiber media to the coax media and back. 

Each of the fiber nodes 106 is connected by a coaxial cable 107 to a respective 
group of cable modems residing at subscriber premises 110A-D. According to the 

10 DOCSIS standard, specific frequency ranges are used for transmitting downstream 
information from the CMTS to the cable modems, and other specific frequency ranges 
are used for transmitting upstream information from the cable modems to the CMTS. 

In order to allow the cable modems to transmit data to the CMTS, the cable 
modems share one or more upstream channels within that domain. Access to the 

15 upstream channel is controlled using a time division multiplexing (TDM) approach. 
Such an implementation requires that the CMTS and all cable modems sharing an 
upstream channel within a particular domain have a common concept of time so that 
when the CMTS tells a particular cable modem to transmit data at time T, the cable 
modem understands what to do. "Time" in this context may be tracked using a counter, 

20 commonly referred to as a timestamp counter, which, according to conventional 
implementations is a 32-bit counter that increments by one every clock pulse. 

Typically, digital data on upstream and downstream channels of the cable 
network is carried over radio frequency ("RF") carrier signals. Cable modems convert 
digital data to a modulated RF signal for upstream transmission and convert 

25 downstream RF signal to digital form. The conversion is done at a subscriber's facility. 
At a Cable Modem Termination System ("CMTS"), located at a Head End Complex of 
the cable network, the conversions are reversed. The CMTS converts downstream 
digital data to a modulated RF signal, which is carried over the fiber and coaxial lines 
to the subscriber premises. The cable modem then demodulates the RF signal and feeds 

30 the digital data to a computer. On the return path, the digital data is fed to the cable 
modem (from an associated PC for example), which converts it to a modulated RF 
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signal. Once the CMTS receives the upstream RF signal, it demodulates it and transmits 
the digital data to an external source. 

Typically, the use of RF modulated optical signals in a conventional cable 
network only allows for very narrow opportunities to transmit IP packets. This is 
5 because most of the bandwidth of the RF modulated optical signal is used for DOCSIS 
related signaling between the Head End Complex 102 and plurality of cable modems. 
As a result, most conventional cable networks are not equipped to handle increased data 
flows relating to new and emerging broadband network applications such as video-on- 
demand, telephony, etc. 
10 Accordingly, there exists a continual need to improve access network 

configurations in order to accommodate new and emerging network applications and 
technologies. 

SUMMARY OF THE INVENTION 
According to specific embodiments of the present invention, various 

15 methods, computer program products, and systems are disclosed for synchronizing 
devices in an access network. The access network includes a Head End Complex and a 
plurality of end nodes which utilize at least one upstream channel and at least one 
downstream channel for communicating with the Head End Complex. The access 
network further includes a plurality of fiber nodes interposed between the Head End 

20 Complex and the plurality of end nodes. Each fiber node is configured to communicate 
with the Head End Complex and the plurality of end nodes via the upstream and 
downstream channels. According to a specific embodiment, at least a portion of the 
end nodes and fiber nodes each include local clock circuitry for generating a local clock 
signal. In a specific implementation of the invention, a common clock reference signal 

25 is provided to the local clock circuitry in selected network devices to thereby cause each 
of the selected network devices to be synchronized to the common clock reference 
signal. In one embodiment, the common clock reference signal is distributed to the 
selected network devices via a first downstream channel. 

Other embodiments of the present invention are directed to methods, computer 

30 program products, and systems for synchronizing devices in an access network. The 
access network includes a Head End Complex and a plurality of end nodes which 
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utilize at least one upstream channel and at least one downstream channel for 
communicating with the Head End Complex. The access network further includes a 
plurality of fiber nodes interposed between the Head End Complex and the plurality of 
end nodes. Each fiber node is configured to communicate with the Head End Complex 
5 and the plurality of end nodes via the upstream and downstream channels. The plurality 
of fiber nodes includes an RF fiber node and a packet fiber node. The packet fiber node 
includes a distributed cable modem termination system (DCMTS). According to a 
specific embodiment, at least a portion of the end nodes and fiber nodes each include 
local clock circuitry for generating a local clock signal. A common clock reference 

10 signal is received at a first packet fiber node. Using the common clock reference signal, 
a local clock signal is generated at the first packet fiber node which is synchronized 
with the common clock reference signal. The local clock signal is then provided to 
components at the first packet fiber node, including the DCMTS. 

Other embodiments of the present invention are directed to methods, computer 

15 program products, and systems for synchronizing devices in an access network. The 
access network includes a Head End Complex and a plurality of end nodes which 
utilize at least one upstream channel and at least one downstream channel for 
communicating with the Head End Complex. The access network further includes a 
plurality of fiber nodes interposed between the Head End Complex and the plurality of 

20 end nodes. Each fiber node is configured to communicate with the Head End Complex 
and the plurality of end nodes via the upstream and downstream channels. The plurality 
of fiber nodes includes an RF fiber node and a packet fiber node. The packet fiber node 
includes a distributed cable modem termination system (DCMTS). According to a 
specific embodiment, at least a portion of the end nodes and fiber nodes each include 

25 local clock circuitry for generating a local clock signal. Additionally, at least a portion 
of the fiber nodes each include local timestamp circuitry for generating local timestamp 
information. Timestamp synchronization information is received at a first packet fiber 
node. Using the timestamp synchronization information, local timestamp information 
is generated at the first packet fiber node which is synchronized with the timestamp 

30 synchronization information. 

According to specific embodiments of the present invention, local clock 
reference signals generated at selected network devices may be synchronized to a 
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common clock frequency. Additionally, according to specific embodiments of the 
invention, local timestamps generated at selected network devices may also be 
synchronized. In specific embodiments where the present invention is implemented in 
a cable network, local clock signals generated at selected DCMTS devices may be 
5 synchronized to a national clock such as, for example, a Stratrum 1. Additionally, by 
providing synchronized timestamp information to selected DCMTS devices in the cable 
network, local timestamps generated at the selected DCMTS devices may also be 
synchronized. 

Additional objects, features and advantages of the various aspects of the present 
10 invention will become apparent from the following description of its preferred 
embodiments, which description should be taken in conjunction with the accompanying 
drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 
FIGURE 1 shows a block diagram of a conventional two-way hybrid fiber- 
15 coaxial (HFC) cable network 100. 

FIGURES 2A and 2B illustrate specific embodiments of cable networks which 
may be used for implementing the synchronization technique of the present invention. 

FIGURE 3 shows a specific embodiment of a DCMTS Synchronization Module 
300 in accordance with a specific embodiment of the present invention. 
20 FIGURE 4 shows a block diagram of various componentry which may reside 

within a cable modem implemented in accordance with a specific embodiment of the 
present invention. 

FIGURE 5 shows a block diagram of various components of a cable network 
500 which may be used for implementing the synchronization technique in accordance 
25 with a specific embodiment of the present invention. 

FIGURE 6 shows an alternate embodiment of a portion of a cable network 600, 
illustrating various components which may be used for implementing an alternate 
embodiment of the synchronization technique of the present invention. 

FIGURE 7 shows a block diagram of a specific embodiment of a Cable Modem 
30 Termination System (CMTS) 700 which may be used to implement certain aspects of 
the present invention. 
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FIGURE 8 shows a specific embodiment of a line card 800 which may be used 
for implementing certain aspects of the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
5 FIGURES 2A and 2B illustrate specific embodiments of cable networks which 

may be used for implementing the synchronization technique of the present invention. 
In the embodiment of FIGURE 2A, the Head End complex 202 includes a centralized 
CMTS device 201 which may be configured to implement DOCSIS functionality. A 
specific embodiment of the CMTS 201 is described in greater detail below with respect 

10 to FIGURES 7 and 8 of the drawings. 

As show in FIGURE 2A, the cable network 200 includes two different types of 
fiber nodes, namely RF fiber nodes (e.g. 206), and packet fiber nodes (e.g. 220a, 220b). 
According to a specific embodiment, the RF fiber node 206 may be configured as a 
conventional fiber node such as fiber nodes 106 of FIGURE 1. According to a specific 

15 implementation, the RF fiber node 206 may be configured to handle all legacy RF 
downstream and upstream communications (such as, for example, set-top box signals, 
telemetry signals, etc., and communications which occur on centralized DOCSIS 
channels), and may be configured to perform additional functions associated with 
conventional fiber nodes. 

20 As shown in the embodiment of FIGURE 2A, a baseband fiber network 216 

may be deployed which is coupled to the conventional cable network. The baseband 
fiber network may include a plurality of packet fiber nodes 220, which are also coupled 
to the conventional fiber network. Each packet fiber node may be inserted into the cable 
network 200 using a combiner and/or splitter which may be used to add and/or separate 

25 DOCSIS signals into/from the RF lineup. 

Communication between the Head End Complex 202 and the plurality of packet 
fiber nodes 220 may be accomplished via the baseband fiber network 216. For example, 
according to a specific implementation, one or more IP tunnels may be formed between 
the Head End Complex 202 and the plurality of packet fiber nodes 220 in order to allow 

30 for transmission and reception of IP packets. In a specific implementation, the IP 
tunnel(s) may be formed between the CMTS 201 and a DCMTS (residing at one or 
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more packet fiber nodes). The CMTS 201 may be configured to handle layer 3 
functionality, including packet-related decisions, network layer decisions, IP related 
decisions, etc. Additionally, according to a specific implementation, the CMTS may 
also be responsible for handing redundancy and/or failover functionality for selected 
5 DCMTS devices. 

According to specific embodiments of the present invention, each packet fiber 
node may include a distributed CMTS device (herein referred to as a "DCMTS"), 
which is configured to receive and transmit baseband optical signals from/to the Head 
End Complex 202 via baseband fiber network 216. According to a specific 

10 implementation, the DCMTS may be configured to perform conversions between 
packet protocols implemented over the baseband fiber media (e.g. 211, 213) and 
DOCSIS protocols implemented on the coax media (e.g. 209a, 209b). According to a 
specific embodiment, the functionality of the DCMTS may include all or a selected 
portion of the functionality provided by a conventional CMTS device. For example, the 

15 DCMTS may perform, at a relatively local level, at least a portion of the scheduling or 
MAC functions typically performed by conventional CMTS devices residing at the 
Head End complex. Additionally, the DCMTS may be configured to handle layer 1 and 
layer 2 functionality such as the OSI layer management (e.g. physical layer, RF layer, 
hardware), MAC layer management, data link layer management, framing functionality, 

20 DOCSIS protocol functionality, timestamp functionality, etc. 

According to a specific implementations of the present invention, the packet 
fiber nodes may be pushed deeper into the network (i.e. closer to the subscriber groups) 
than conventional RF fiber nodes, which, as illustrated in FIGURE 2A, may result in a 
plurality of packet fiber nodes 220 servicing subscriber groups (e.g. 210a, 210b) which 

25 are serviced by a single RF fiber node 206. For example, the RF fiber node 206 may be 
configured to service 200 households past (HHP) while each packet fiber node may be 
configured to service 100 households past, resulting in 2 packet fiber nodes (220a, 
220b) servicing the 200 households which are serviced by the RF fiber node 206. 

In addition to being configured to receive baseband optical signals, the packet 

30 fiber nodes 220 may also be configured to receive electrical signals from the RF fiber 
nodes via coax lines (e.g. 207A, 207B). As explained in greater detail below with 
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respect to FIGURES 5 and 6 of the drawings, such electrical signals may include clock 
or other timing reference signals and/or timestamp synchronization signals. 

FIGURE 2B shows an alternate embodiment of a cable network 250 which may 
be used for implementing the synchronization technique of the present invention. In the 
5 cable network of FIGURE 2B, the centralized CMTS typically residing at the Head End 
complex 252 has been removed, and its functionality incorporated into selected 
DCMTS devices residing in the packet fiber nodes 225. Thus, according to the 
embodiment of FIGURE 2B, selected DCMTS devices residing in the packet fiber 
nodes 225 may be configured to implement the functions typically implemented by the 

10 centralized CMTS device, such as, for example, layer 3 functionality and/or at least a 
portion of the functionality performed by the various logic described with respect to 
FIGURES 7 and 8 of the drawings. 

According to a specific embodiment, communication of IP packets between the 
Head End complex 252 and the plurality of packet fiber nodes 255 may be 

15 accomplished without the use of a tunneling protocol. In such an embodiment, 
communication between network devices may be accomplished using, for example, a 
standardized IP protocol. Additionally, as shown in the embodiment of FIGURE 2B, 
the Head End complex 252 may include an Ethernet switch 254 or other type of traffic 
handling device which may be configured to route or forward traffic between network 

20 devices in the cable network 250, or between the devices in the cable network and 
devices in external networks. Further, as explained in greater detail below with respect 
to FIGURE 3, the Head End complex may also include a DCMTS Synchronization 
Module 255 which may be configured to provide synchronized clock reference signals 
and/or synchronized timestamp information to the plurality of packet fiber nodes 225. 

25 FIGURE 3 shows a specific embodiment of a DCMTS Synchronization Module 

300 in accordance with a specific embodiment of the present invention. According to 
specific embodiments, the DCMTS Synchronization Module may be configured as an 
internal component of a centralized or master CMTS device (e.g. 201), or may be 
configured as a separate system external to the centralized CMTS (as shown, for 

30 example, at 255 of FIGURE 2B). 

As shown in the embodiment of FIGURE 3, the DCMTS Synchronization 
Module 300 may include appropriate hardware and/or software for implementing 
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redundant clock circuitry in order to provide a master clock or timing reference signal 
to selected packet fiber nodes and their respective DCMTS devices. 

According to specific embodiments, each DCMTS device may be configured to 
include its own clock circuitry for generating a respective internal timing reference 
5 signal to be used by other components of the DCMTS device. However, in 
embodiments where each DCMTS device is configured to include its own respective 
clock circuitry, the internal timing reference signals generated at each of the DCMTS 
devices will most likely not be synchronized with each other. This may be due, for 
example, to minor fluctuations and/or variances which are inherent in each independent 

10 clock circuit. Thus, although each DCMTS clock circuit will try to achieve the same 
frequency as the other DCMTS clock circuits, it is likely that the internal timing 
reference signals generated at the DCMTS devices will not be synchronized in 
frequency and/or phase. 

By providing a master timing reference signal to selected DCMTS devices in the 

15 cable network, the clock signals generated by each of the selected DCMTS devices may 
be synchronized. Moreover, as explained in greater detail below, the synchronization 
technique of the present invention may also be used to synchronize timestamps across 
selected DCMTS devices and selected cable modems in the cable network. 

As shown in the embodiment of FIGURE 3, the DCMTS Synchronization 

20 Module 300 may include a plurality of redundant clock circuits (e.g. Clock Circuitry A 
302 and Clock Circuitry B 304). One or more of the clock circuits may be adapted to 
receive clock signals or synchronization signals from an external source such as, for 
example, a Stratum 1 or a Stratum 3 clock source. In the embodiment of FIGURE 3, 
Clock Circuitry A may be configured to generate a first clock signal (e.g. clock signal 

25 A) and clock circuitry B may be configured to generate a second clock signal (e.g. clock 
signal B). According to a specific embodiment, the clock signals generated by each of 
the clock circuitry devices may be synchronized in phase as well as frequency. In a 
specific implementation, where the DCMTS Synchronization Module is implemented 
in a DOCSIS network operating at a root frequency (e.g. 10.24 MHz), the frequency of 

30 the clock signals generated by each of the clock circuitry devices 302, 304 may be any 
harmonically related frequency or integer multiple of the root frequency. For example, 
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according to a specific embodiment, the frequency of clock signal A and clock signal B 
may each be equal to 20.48 MHz. 

It will be appreciated that in most DOCSIS HFC networks, the downstream 
frequency spectrum below 54 MHz is typically unused. Thus, according to specific 
5 embodiments of the present invention, the frequency n of the master clock reference 
signal should preferably be less than 54 MHz. 

As shown in the embodiment of FIGURE 3, the redundant clock signals (e.g. 
clock signal A, clock signal B) are fed to a relay or switch 308 which is controlled by a 
failover process 305. According to a specific embodiment, control of the relay/switch 
10 circuit 308 may be implemented using a conventional communication protocol such as, 
for example, SNMP. 

The failover process 305 monitors the health of each clock circuit 302, 304. 
According to a specific embodiment, one of the clock circuits (e.g. clock circuitry A) 
may be configured as the primary clock circuit, and the other clock circuit (e.g. clock 
15 circuitry B) may be configured as a backup or redundant clock circuit. During times 
when the failover process 305 detects that the primary clock circuit is operating 
normally, the failover process may cause the relay 308 to output the clock signal from 
the primary clock circuit on line 310. During times when the failover process 305 
detects a failure at the primary clock circuit, the failover process may then cause the 
20 relay 308 to switch its output clock signal to the backup clock signal generated by the 
backup clock circuit. 

According to a specific implementation, the output clock signal on line 310 may 
correspond to a sine wave having the frequency of n MHz . For purposes of illustration, 
it will be assumed that the value n = 20.48. As explained in greater detail below, the 
25 output clock signal will eventually be distributed to selected packet fiber nodes in the 
cable network in order to synchronize the phase and/or frequency of the local clock 
signals generated at each of the selected packet fiber nodes. 

FIGURE 5 shows a block diagram of various components of a cable network 
500 which may be used for implementing the synchronization technique in accordance 
30 with a specific embodiment of the present invention. For purposes of illustration, it is 
assumed that the network 500 of FIGURE 5 is used to transmit a master clock reference 
signal to selected packet fiber nodes in the cable network. 
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The master clock reference signal may originate at clock circuitry block 502. 
According to a specific implementation, the clock circuitry block 502 may reside at the 
Head End complex of the cable network, and may include various logic described in the 
DCMTS Synchronization Module of FIGURE 3. 
5 The clock circuitry 502 is configured to generate a clock reference signal having 

a frequency of n MHz on line 501. This clock reference signal may then be passed 
through a low pass filter 504 and an amplifier 506. According to a specific 
embodiment, the amplifier 506 may correspond to an RF amplifier which is configured 
to output a sine wave of n MHz on line 505. The clock reference signal on line 505 is 

10 then combined with other cable network signals at a combiner 508. 

The combined signals, which include the master clock reference signal of n 
MHz are transmitted to one or more RF fiber nodes 516. In a specific embodiment, 
where the synchronization technique of the present invention is implemented in a 
conventional cable network, the combined signals are passed from the combiner 508 

15 via a coax cable 507 to an electrical-optical converter 512 which converts the signals 
into RF modulated optical signals to be transmitted to the RF fiber nodes 516 via RF 
fibers 509. At the RF fiber node, the combined downstream signals are converted back 
into electrical signals and output onto coax line 514. As shown in the embodiment of 
FIGURE 5, one or more packet fiber nodes 520 may be configured to receive the 

20 downstream signals on coax line 514. 

At the packet fiber node 520, the combined downstream signals are passed 
through a band pass filter 522 which is configured to extract out the master clock 
reference signal of n MHz . The master clock reference signal is then passed to the 
DCMTS device 524, whereupon the master clock reference signal frequency of n MHz 

25 is used to accurately drive the timestamp generator 526. The timestamp information 
generated by the timestamp generator 526 is then passed via an up converter 528 to a 
combiner 530 which combines the timestamp information signals with the other 
downstream signals from line 514 to be output to a selected group of cable modems. 
According to a specific embodiment, the DCMTS 524 is configured to handle the 

30 timestamp functionality conventionally implemented at the centralized CMTS. Such 
timestamp functionality may include, for example, generating and transmitting 
modulated timestamp signals to selected cable modems in the cable network. 
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Using the technique of the present invention as described, for example, in 
FIGURE 5, a master clock reference signal may be provided to selected packet fiber 
nodes in order to synchronize the local clock reference signals generated at the selected 
packet fiber nodes and/or the selected DCMTS devices associated with each packet 
5 fiber node. Thus, the technique of the present invention provides a master reference 
signal for synchronizing each of the internal reference timing signals at selected 
DCMTS devices. According to a specific embodiment, each clock circuit residing at a 
DCMTS device may be configured to be a slave to the master timing reference signal 
generated at the Head End complex of the cable network. In this way, selected portions 

10 of the cable network may be synchronized to a common timing reference signal. 

FIGURE 6 shows an alternate embodiment of a portion of a cable network 600, 
illustrating various components which may be used for implementing an alternate 
embodiment of the synchronization technique of the present invention. As shown in the 
embodiment of FIGURE 6, a master timing reference signal (e.g. clock reference 

15 signal) is distributed to selected packet fiber nodes. Additionally, synchronized 
timestamp information is also provided to selected packet fiber nodes in order to 
achieve synchronization of timestamps across network devices in a selected portion of 
the cable network. According to a specific embodiment, the synchronization of 
timestamps at the packet fiber nodes results in the synchronization of timestamps 

20 generated at selected cable modems in the cable network. Since the timestamps may 
also be used for scheduling of packet traffic, the scheduling of packet traffic may also 
be synchronized across selected portions of the cable network. 

It will be appreciated that if no synchronized timestamp information were 
distributed to packet fiber nodes in the cable network, each packet fiber node would 

25 generate its own timestamp according to its respective local time base. In such a 
situation, there would be no guarantee that any of the packet fiber nodes or DCMTS 
devices would have synchronized timestamps. However, by distributing synchronized 
timestamp information to each of the packet fiber nodes and/or DCMTS devices, 
synchronization of timestamps between selected DCMTS devices and cable modems 

30 may be achieved. 

According to a specific embodiment, the synchronized timestamp information 
may be provided to various network components using a modulated carrier frequency. 
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According to one implementation, the carrier frequency corresponds to the master 
timing reference signal or clock reference signal described previously with respect to 
FIGURE 3 and FIGURE 5. 

As shown in FIGURE 6, clock circuitry 602 is provided for generating a master 
5 timing reference or clock reference signal 601. According to a specific embodiment, the 
clock circuitry 602 may be implemented at the Head End complex of the cable network. 
Additionally, according to one implementation, the clock circuitry 602 may include 
various logic described in the DCMTS Synchronization Module of FIGURE 3. 

The clock circuitry 602 is configured to generate a master clock reference signal 

10 601 having a frequency of n MHz, which is used to drive various componentry, 
including master timestamp generator 604 and signal modulation circuitry 608. The 
timestamp generator outputs timestamps to framing circuitry 606, which then passes the 
framed timestamp information to signal modulation circuitry 608. The signal 
modulation circuitry 608 utilizes the master clock reference signal and the framed 

15 timestamp information to generate a modulated clock reference signal which includes 
the timestamp information generated by master timestamp generator 604. According to 
a specific embodiment, the frequency of the modulated clock reference signal is the 
same as the frequency of the clock reference signal provided by clock circuitry 602, 
namely n MHz. The modulated clock reference signal (which includes the timestamp 

20 information) is then passed along with other downstream channel information to the 
HFC plant components 510 such as those described previously with respect to FIGURE 
5. 

In a specific implementation, the master timestamp generator 604, framing 
circuitry 606, and signal modulation circuitry 608 may also reside at the Head End 

25 complex of the cable network. Additionally, according to a specific implementation, 
the timestamp generator, framing circuitry, and signal modulation circuitry may each be 
configured to function in accordance with the standardized DOCSIS protocol. 

According to specific embodiments, the downstream channels, including the 
modulated clock reference signal are provided to one or more packet fiber nodes (e.g. 

30 620). A band pass filter 640 may be used at the packet fiber node to extract the 
modulated clock reference signal from the other downstream signals. The modulated 
clock reference signal is then passed to a phase lock loop (PLL) device in order to 
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recover the clock reference signal (e.g. n MHz frequency). The recovered clock 
reference signal is then used to drive the timestamp generator 626. 

Additionally, the modulated clock reference signal is also passed to the signal 
demodulation circuitry 622 and framing circuitry 624 in order to recover the timestamp 
5 information embedded in the modulated clock reference signal. The recovered 
timestamp information is then used to synchronize the timestamp generator 626 with 
the master timestamp information generated by master timestamp generator 604. In this 
way, timestamps generated by selected fiber nodes may be synchronized with each 
other. 

10 For example, as shown in the embodiment of FIGURE 6, a comparitor 632 may 

be used to compare the master timestamp information to the timestamp information 
generated by timestamp generator 626. The comparitor 632 may generate an error 
signal 625 which is fed back to the timestamp generator 626 in order to cause the 
timestamps generated by timestamp generator 626 to be synchronized with the Master 

15 timestamp information. The output signal produced by the timestamp generator 626 on 
line 629 may then be used to feed other components in the packet fiber node. 

As shown in the embodiment of FIGURE 6, the timestamps generated by 
timestamp generator 626 are provided to DCMTS device 642. According to a specific 
implementation, the DCMTS device 642 may be configured to accept or utilize external 

20 timestamp information such as that generated by timestamp generator 626. According 
to an alternate embodiment, the DCMTS may be configured to include the timestamp 
generating circuitry illustrated in FIGURE 6 such as, for example, timestamp generator 
626, comparitor 632, etc. In this alternate embodiment, the DCMTS may be configured 
to utilize the master clock reference signal for driving its internal components, and may 

25 also be configured to utilize the master timestamp information to synchronize its 
internal timestamp generator with other timestamp devices in the cable network. 

Timestamp signals as well as other DOCSIS signals may then be passed from 
the DCMTS device 642, via up converter 644, to combiner 630 whereupon the signals 
are then distributed along with the other downstream channel information to the cable 

30 modems. 

FIGURE 4 shows a block diagram of various componentry which may reside 
within a cable modem implemented in accordance with a specific embodiment of the 
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present invention. In the embodiment of FIGURE 4, it is assumed that the cable modem 
is configured to implement the standardized DOCSIS protocol. As shown in FIGURE 
4, the cable modem may include a local clock source 408 which is configured to 
provide a clock reference signal to a timestamp generator 406. According to a specific 
5 implementation, the timestamp generator 406 may be implemented using a counter. 
Additionally, according to one implementation, the frequency of the clock reference 
signal provided to the timestamp generator on line 407 is equal to 20.48 MHz . 

As shown in FIGURE 4, the cable modem also includes signal demodulation 
circuitry 402 which receives modulated DOCSIS timestamp information via coax line 

10 401. The signal demodulation circuitry 402 demodulates the incoming timestamp 
signals, and passes the demodulated signals to framing circuitry 404, which extracts the 
timestamp information provided by an external entity (such as, for example, the Head 
End complex or fiber node servicing the cable modem). The timestamp information 
provided by the external entity is compared, at comparitor circuitry 412, to the 

15 timestamp information generated by timestamp generator 406. The comparitor 412 
generates an error signal 405 which is fed back to the timestamp generator 406 in order 
to cause the timestamps generated by timestamp generator 406 to be synchronized with 
the timestamps generated by the external entity. The output signal produced by the 
timestamp generator 406 on line 409 is then used to feed the remaining cable modem 

20 circuits (not shown). 

It will be appreciated that the cable modem circuitry described in FIGURE 4 has 
been configured to receive external timestamp information in order to synchronize its 
internal timestamp generating circuitry. Moreover, in specific embodiments where 
timestamp information has been synchronized across a plurality of different fiber nodes, 

25 the timestamps generated at each of the cable modems serviced by such fiber nodes will 
also be synchronized. 

It will be appreciated that by synchronizing the clock reference signals in each 
of the DCMTS devices to a common clock frequency, the upstream and/or downstream 
channels across each of the DCMTS devices may also be synchronized. Additionally, 

30 timestamps may also be synchronized across upstream and/or downstream channels 
associated with different DCMTS devices in the cable network. Further, by 
synchronizing timestamp information across selected DCMTS devices, channel MAP 
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messages and transmission intervals may be valid across different DCMTS devices. 
Accordingly, cable modems may be allowed to switch between upstream and/or 
downstream channels associated with different DCMTS devices without having to 
obtain new timestamp information each time a channel change is performed between 
5 DCMTS devices. 

It will also be appreciated that, by synchronizing the clock reference signal 
and/or timestamp information across different DCMTS devices in the cable network, a 
number of additional advantages may be realized. For example, using the 
synchronization technique of the present invention, cable modems may be load shared 

10 between different DCMTS devices in the cable network. Additionally, cable modems 
may also be load shared between a master CMTS device (e.g. residing at the Head End 
complex) and one or more DCMTS devices. Additionally, using the synchronization 
technique of the present invention, a master CMTS and distributed CMTS device are 
able to co-exist on the same HFC plant with overlapping upstream frequencies. 

15 Additionally, using the synchronization technique of the present invention, a national 
clock such as, for example, a Stratrum 1 clock may be provided to various components 
in the cable network in order to facilitate the synchronizing of voice over IP CODECS, 
and to generate DOCSIS timestamps having a high degree of accuracy (e.g. less than 5 
ppm). 

20 Additionally, the synchronization technique of the present invention allows a 

lower cost circuit to be used in the temperature hardened environment of the DCMTS 
for the upstream PLL. For example, according to specific implementations, it is 
preferable to provide to various devices in the cable network, a 5 ppm (or less) clock 
signal which is stable over full temperature, time, and voltage conditions. One 

25 implementation for meeting such requirements would be to provide a stand alone circuit 
at the packet fiber node. Another implementation would be to provide a clock circuit at 
the CMTS which then provides a stable clock reference to a PLL circuit in the DCMTS. 

Other Embodiments 

Generally, the synchronization technique of the present invention may be 
30 implemented on software and/or hardware. For example, it can be implemented in an 
operating system kernel, in a separate user process, in a library package bound into 
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network applications, on a specially constructed machine, or on a network interface 
card. In a specific embodiment of this invention, the technique of the present invention 
may be implemented in software such as an operating system or in an application 
running on an operating system. 
5 A software or software/hardware hybrid system of this invention is preferably 

implemented on a general-purpose programmable machine selectively activated or 
reconfigured by a computer program stored in memory. Such a programmable machine 
may be a network device designed to handle network traffic. Such network devices 
typically have multiple network interfaces. One important class of device that may be 
10 used to implement the present invention is the Cable Modem Termination System. 
Preferably, the CMTS is a "routing" CMTS, which handles at least some routing 
functions. Alternatively, the CMTS may be a "bridging" CMTS, which handles only 
lower-level tasks. 

FIGURE 7 shows a block diagram of a specific embodiment of a Cable Modem 

15 Termination System (CMTS) 700 which may be used to implement certain aspects of 
the present invention. As shown in FIGURE 7, the CMTS 700 may comprise a plurality 
of routing engines (e.g. 701a, 701b). In a specific implementation, Routing Engine A 
701a may be configured as a primary or working routing engine, while Routing Engine 
B 701b may be configured as a backup or standby routing engine which provides 

20 redundancy functionality. 

As shown in the embodiment of FIGURE 7, each of the routing engines may 
include a variety of similar modules and/or components. In order to avoid confusion, 
the various components and/or modules relating to Routing Engine A 701a will now be 
described in greater detail with the understanding that such descriptions may also be 

25 applied to the corresponding components and modules of Routing Engine B 701b. 

According to a specific embodiment, Routing Engine A may be configured or 
designed to include a plurality of functionally different modules or components, 
including, for example, a Forwarding Processor (FP) Module 711a adapted to provide 
packet forwarding functionality; a Route Processor (RP) Module 703a adapted to 

30 implement routing or forwarding operations; a utility component 702a adapted to 
provide system clock and timestamp functionality; etc. The routing engine components 
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provide may be configured to provide layer one, layer two, layer three and layer four 
functionality as well as quality of service (QoS) functionality. 

According to a specific implementation, the RP Module 703a may be 
configured as a processor-based routing system comprising functionality incorporated 
5 within a typical router, such as, for example, specially configured router models 1600, 
2500, 2600, 3600, 4500, 4700, 7200, 7500, 10012, and 12000 available from Cisco 
Systems, Inc. of San Jose, California. For example, as shown in the embodiment of 
FIGURE 7, the RP Module 703a comprises a general-purpose processor 705a (e.g., a 
MIPS route processor) coupled to a system controller 709a and memory 707a. It should 

10 be noted that components have been described in singular form for clarity. One skilled 
in the art would appreciate that multiple processors, a variety of memory formats, or 
multiple system controllers, for example, can be used in this context as well as in other 
contexts while falling within the scope of the present invention. The memory 707a may 
comprise synchronous dynamic random access memory (SDRAM) storage locations 

15 addressable by the processor 705a for storing software programs and data structures 
accessed by the components. A network routing operating system, portions of which 
may reside in memory and executed by the route processor, functionally organizes the 
router by invoking network operations in support of software processes executing on 
the router. 

20 The RP processor 705a may be configured to construct and load routing tables 

used by the FP Module 711a. The processor 705a may also be configured or designed to 
perform configuration management functions of the routing engine 701a, and to 
communicate with neighboring peer, standby, and/or backup routers to exchange 
protocol data units used to construct the routing tables in accordance with conventional 

25 routing algorithms. It will be apparent to those skilled in the art that other memory 
types, including various computer readable media, may be used for storing and 
executing program instructions pertaining to the operation of the routing engine. 

Interface circuitry 727a may be coupled to the respective interface circuitry 
733a, 733b of line cards 731a, 731b. According to a specific implementation, interface 

30 circuitry 727a may be configured to reside on a backplane logic circuit 723a of the 
routing engine. In one example, the backplane logic circuit 723a is embodied as a high 
performance, application specific integrated circuit (ASIC). An example of a backplane 
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logic circuit that may be advantageously used with the present invention is disclosed in 
co-pending and commonly owned U.S. Patent Application Serial No. 09/791,063, filed 
on February 22, 2001, the entirety of which is hereby incorporated by reference for all 
purposes. 

5 According to a specific embodiment, the backplane logic circuit (which, 

according to a specific implementation, may be configured as an ASIC), may be 
configured to further interface the line cards to a packet buffer 725a and a forwarding 
engine 721a of the FP Module 711a. The packet buffer 725a may include memory 
which is configured to store packets as the forwarding engine 721a performs its packet 

10 forwarding functions. For example, the packet buffer may be used to store low priority 
data packets while high priority, low latency voice packets are forwarded by the 
forwarding engine to a data network interface 735a. According to various embodiments, 
the FP Module 711 may comprise a processor 713a and memory 715a for handling 
transport layer 717 and network layer 719 functionality. In one implementation, the 

15 processor 713a may be configured to track accounting, port, and billing information for 
various users on a cable modem network 751. The processor 713a may also be 
configured to maintain desired service flow or session state information in memory 
715a such as, for example, for voice calls initiated over the cable modem network. The 
FP Module 711a may also be configured to provide transaction compacting 

20 functionality, data parcel tunneling functionality, switching functionality, timestamp 
functionality, etc. 

According to a specific implementation, Routing Engine A 701a may be 
connected to Routing Engine B 701b via at least one link 746, such as, for example, a 
backplane line or system bus. Routing engine redundancy may be provided by 

25 designating one of the routing engines as the working or primary routing engine and 
designating the other routing engine(s) as the redundant or standby routing engine(s). 
When configured as a working routing engine, the Routing Engine A may perform all 
appropriate forwarding and routing functions. When a failure occurs at the working 
routing engine, the redundant routing engine (e.g. Routing Engine B) may then take 

30 over the operations of the working routing engine. Thereafter, when Routing Engine A 
recovers, it may assume the functions of the redundant routing engine, or it may take 
over the functions of the working routing engine. 
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According to different embodiments of the present invention, one or more of the 
routing engines may be configured to communicate with a plurality of line cards (e.g. 
731, 735) via point-to-point links. For example, as shown in FIGURE 7, each of the 
plurality of line cards 731 and 735 are connected to each of the routing engines 701a, 
5 701b via point-to-point links 741 and 743. One advantage of the point-to-point link 
configuration is that it provides additional reliability in that the failure of one or more 
line cards will not interfere with communications between other line cards and the 
routing engine(s). For example, if Line Card A 731a suddenly failed, each of the routing 
engines would still be able to communicate with the other line cards. 

10 According to a specific embodiment, the plurality of line cards may include 

different types of line cards which have been specifically configured to perform specific 
functions. For example, line cards 731 may correspond to radio-frequency (RF) line 
cards which have been configured or designed for use in a cable network. Additionally, 
line cards 735 may correspond to network interface cards which have been configured 

15 or designed to interface with different types of external networks (e.g. WANs, LANs,) 
utilizing different types of communication protocols (e.g. Ethernet, Frame Relay, ATM, 
TCP/IP, etc). For example, the data network interface 735a functions as an interface 
component between external data sources and the cable system. The external data 
sources transmit data to the data network interface 735a via, for example, optical fiber, 

20 microwave link, satellite link, or through various media. A data network interface may 
include hardware and software for interfacing to various networks. According to 
various embodiments, a data network interface may be implemented on a line card as 
part of a conventional router for a packet-switched network. Using this type of 
configuration, the CMTS is able to send and/or receive TP packets to and from the data 

25 network interface using, for example, network layer software 719a. 

According to a specific implementation, the operations associated with 
obtaining an IP address for cable modems may be implemented by the network layer 
software. This may involve the CMTS communicating with a DHCP server (not shown) 
via a data network interface, for example. 

30 As shown in FIGURE 7, at least a portion of the line cards includes interface 

circuitry for providing an appropriate interface between the host line card, other line 
cards, and/or the routing engine(s). For example, interface circuitry 733a may include 
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interconnect ports coupled to one or more of the point-to-point links 741, 743. 
According to a specific implementation, the interface circuitry functions as a translator 
that converts conventional formats of data received at the line cards to a suitable 
protocol format for transmission from the line card to the appropriate routing engine. In 
5 one implementation, the interface circuitry 733a may also include circuitry to perform 
cyclic redundancy code (CRC) generation and checking on packets, along with 
interconnect format checking. 

According to a specific embodiment, the point-to-point links 741, 743 may be 
configured as clock forwarded links such that each point-to-point link comprises a at 

10 least one data wire for transporting data signals and at least one clock wire for carrying 
clock reference signals. However, it will be understood to those skilled in the art that 
the clock forwarding technique may be scaled to accommodate other clock forwarding 
arrangements such as, for example, connections comprising a plurality or data signals 
and/or clock reference signals. Additionally, according to a specific embodiment, each 

15 line card may be configured to provide at least one communication interface between 
the routing engines (701a, 701b) and a portion of the cable network. The data network 
interface 735a may couple the routing engine 701a to an external data network 755 such 
as, for example, the Internet. 

According to one embodiment, all or selected lines cards, routing engines and/or 

20 data network interfaces may be configured to use at least one common dedicated line or 
backplane (e.g. 745). According to other embodiments, the routing engines 701a, 701b 
may have an additional dedicated connection(s) for supporting redundancy. In a specific 
implementation, the backplane may be configured as an Ethernet medium that is shared 
by the CMTS. When the line cards are inserted into the backplane, they communicate 

25 with the routing engines over the lines 745 in accordance with a "capabilities" exchange 
that identifies the types of line cards and their various characteristics/parameters. 

According to a specific implementation, during initialization of the CMTS, the 
routing engines 701a and 701b negotiate for working routing engine status over the 
backplane. Assertion of working status causes the line cards 731 to configure their 

30 respective interface circuitry to communicate with the designated working routing 
engine (e.g. Routing Engine A 701a). The Routing Engine A 701a then configures the 
CMTS and line cards, establishes routing relationships, and initiates traffic forwarding 
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operations. The redundant routing engine 701b may complete a self -test and perform 
initialization of its various functions. The two routing engine assemblies may then 
exchange conventional negotiation messages (which may include, for example, health 
and status messages) via the backplane lines 745. According to a specific 
5 implementation, the exchanged messages are defined by an Enhanced High System 
Availability (EHSA) negotiation algorithm available from Cisco Systems, Inc. of San 
Jose, California. The redundant routing engine may also request transaction information 
from the working routing engine. 

When the redundant routing engine 701b detects that the primary routing engine 

10 has failed, the redundant routing engine may take over as the new working routing 
engine, and initiate a "cutover" operation to thereby cause the line card interface 
circuitry (e.g. 733a, 733b) to identify and communicate with the new working routing 
engine 701b. The new working routing engine 701b may then access and retrieve state 
information (such as, for example, telephone call state information, service flow state 

15 information, etc.) stored on selected line cards in order to maintain existing service 
flows. 

Prior to a failure situation, the redundant routing engine 701b may be configured 
to monitor the status of the working routing engine 701a, and may further be configured 
or designed to receive updated configuration, transaction and/or state information, 
20 which may then be stored in an appropriate location in the redundant routing engine 
701b. 

The line cards may further comprise circuitry for "looping" packets back onto 
the redundant routing engine 701b over the point-to-point links. This allows the 
redundant routing engine 701b to send and receive test packets to evaluate its own 
25 operation in addition to the operation of the dedicated lines prior to the occurrence of a 
system failure. 

The synchronization techniques of the present invention may be implemented 
on various general purpose Cable Modem Termination Systems. In a specific 
embodiment, the systems of this invention may be specially configured CMTSs such as, 
30 for example, specially configured models in the uBR-7200 and uBR-10012 series of 
CMTSs available from Cisco Systems, Inc. of San Jose, California. In an alternative 
embodiment, the methods of this invention may be implemented on a general-purpose 
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network host machine such as a personal computer or workstation. Further, the 
invention may be at least partially implemented on a card (e.g., an interface card) for a 
network device or a general-purpose computing device. 

Although the system shown in FIGURE 7 represents one specific CMTS 
5 architecture of the present invention, it is by no means the only CMTS architecture on 
which the present invention can be implemented. For example, other types of interfaces 
and media could also be used with the CMTS. 

Regardless of network device's configuration (for cable plants or otherwise), it 
may employ one or more memories or memory modules (e.g., memory 707a, 715a, etc.) 

10 configured to store program instructions for the network operations and other functions 
of the present invention described herein. The program instructions may specify an 
operating system and one or more applications, for example. Such memory or memories 
may also be configured to store data structures, or other specific non-program 
information described herein. 

15 Because such information and program instructions may be employed to 

implement the systems/methods described herein, the present invention relates to 
machine-readable media that include program instructions, state information, etc. for 
performing various operations described herein. Examples of machine-readable media 
include, but are not limited to, magnetic media such as hard disks, floppy disks, and 

20 magnetic tape; optical media such as CD-ROM disks; magneto-optical media such as 
floptical disks; and hardware devices that are specially configured to store and perform 
program instructions, such as read-only memory devices (ROM) and random access 
memory (RAM). The invention may also be embodied in a carrier wave travelling over 
an appropriate medium such as airwaves, optical lines, electric lines, etc. Examples of 

25 program instructions include both machine code, such as produced by a compiler, and 
files containing higher level code that may be executed by the computer using an 
interpreter. 

Figure 8 shows a specific embodiment of a line card 800 which may be used for 
implementing certain aspects of the present invention. According to a specific 
30 embodiment, the line card 800 may be configured or designed to implement selected 
aspects of the DOCSIS functionality which were conventionally implemented by the 
CMTS, such as, for example, DOCSIS MAC functionality. 
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In the specific embodiment as shown in FIGURE 8, line card 800 provides 
functions on several network layers, including a physical layer 832, and a Media Access 
Control (MAC) layer 830. Generally, the physical layer is responsible for receiving and 
transmitting RF signals on the cable plant. Hardware portions of the physical layer 
5 include at least one downstream modulator and transmitter 806 and/or at least one 
upstream demodulator and receiver 814. The physical layer also includes software 886 
for driving the hardware components of the physical layer. 

Upstream optical data signals (packets) arriving via an optical fiber node are 
converted to electrical signals, and then demodulated by the demodulator/receiver 814. 

10 The demodulated information is then passed to MAC layer block 830. 

A primary purpose of MAC layer 830 is to encapsulate, with MAC headers, 
downstream packets and decapsulate, of MAC headers, upstream packets. In one 
embodiment, the encapsulation and decapsulation proceed as dictated by the above- 
mentioned DOCSIS standard for transmission of data or other information. The MAC 

15 headers include addresses to specific modems (if sent downstream), or to the CMTS (if 
sent upstream). Note that the cable modems also include MAC addressing components. 
In the cable modems, these components encapsulate upstream data with a header 
containing the MAC address of the CMTS. 

MAC layer 830 includes a MAC hardware portion 834 and a MAC software 

20 portion 884. The MAC layer software portion may include software relating to DOCSIS 
MAC functionality, etc. The MAC layer hardware and software portions operate 
together to provide the above-described DOCSIS MAC functionality. In a preferred 
embodiment, MAC controller 834 is dedicated to performing some MAC layer 
functions, and is distinct from processor 855. 

25 After MAC layer block 830 has processed the upstream information, it is then 

passed to interface circuitry 802. As described previously, interface circuitry 802 
includes the appropriate hardware and/or software for converting data formats received 
at the line cards to a suitable protocol format for transmission from the line card to an 
appropriate routing engine. 

30 When a packet is received from the routing engine at the interface circuitry 802, 

the packet is then passed to MAC layer 830. The MAC layer 830 transmits information 
via a one-way communication medium to downstream modulator and transmitter 806. 
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Downstream modulator and transmitter 806 takes the data (or other information) in a 
packet structure and converts it to modulated downstream frames, such as MPEG or 
ATM frames, on the downstream carrier using, for example, QAM64 modulation. 
Other methods of modulation may also be used such as, for example, QAM256 
5 modulation, CDMA (Code Division Multiple Access), OFDM (Orthogonal Frequency 
Division Multiplexing), FSK (FREQ Shift Keying), etc. The return data is likewise 
modulated using, for example, QAM16 or QSPK. According to a specific embodiment, 
the modulated data is converted from IF electrical signals to RF electrical signals (or 
vice-versa) using one or more electrical signal converters (not shown). 

10 As shown in FIGURE 8, line card 800 includes a central hardware block 850 

including one or more processors 855 and memory 857. These hardware components 
interact with software and other hardware portions of the various layers within the line 
card. They provide general purpose computing power for much of the software. 
Memory 857 may include, for example, I/O memory (e.g. buffers), program memory, 

15 shared memory, etc. One or more data structures used for implementing the technique 
of the present invention may reside in such memory. In one embodiment, the software 
entities 882, 884, and 886 are implemented as part of a network operating system 
running on hardware 850. Preferably, at least a part of the synchronization functionality 
of this invention are implemented in software as part of the operating system. In 

20 FIGURE 8, such software may be part of MAC layer software 884, or may be closely 
associated therewith. Of course, the synchronization logic of the present invention 
could reside in hardware, software, or some combination of the two. 

According to a specific implementation, the procedures typically employed by 
the CMTS during registration and pre-registration may be performed at the MAC layer 

25 of the line card 800. In such an embodiment, most of the registration operations may be 
performed by the hardware and software provided for MAC layer logic 830. 

It will be appreciated that, according to a specific embodiments, at least a 
portion of functions described herein which are performed by the CMTS (e.g. FIGURE 
7), line cards (e.g. FIGURE 8), or selected components thereof, may be implemented in 

30 a centralized CMTS system (e.g. residing the Head End Complex of the cable network, 
as shown, for example, in FIGURE 9), and/or may be implemented at one or more 
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distributed CMTS (DCMTS) systems (e.g. residing at one or more fiber nodes, as 
shown, for example, in FIGURE 10). 

Further, it will be appreciated by one having ordinary skill in the art that the 
technique of the present invention may be implemented in any computer network 
5 having a standardized protocol for utilizing a central termination system (e.g. Head 
End) to schedule timeslots for remote stations or nodes on a return (or upstream) 
channel. In wireless networks, the central termination system may be referred to as a 
Head End or wireless base station. In satellite networks, the central termination system 
may be referred to as a master controlling station. 
10 Although several preferred embodiments of this invention have been described 

in detail herein with reference to the accompanying drawings, it is to be understood that 
the invention is not limited to these precise embodiments, and that various changes and 
modifications may be effected therein by one skilled in the art without departing from 
the scope of spirit of the invention as defined in the appended claims. 
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